Methods and systems for extracting brushing motion characteristics of a user using an oral hygiene device including at least one accelerometer to provide feedback to a user

ABSTRACT

Systems and methods for enhancing a user&#39;s efficiency while operating an oral hygiene device ( 10 ) is provided. In an exemplary embodiment, motion information of an oral hygiene device is received from one or more accelerometers ( 32 ) located within the oral hygiene device. The received motion information is compared to a targeted motion of the oral hygiene device. The user operating the oral hygiene device is then provided with feedback in response to determining that the received motion information is within a predefined range of the targeted motion information.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present disclosure generally relates to oral hygiene devices and, inparticular, oral hygiene devices including at least one accelerometeroperable to determine a quality of a brushing motion of the oral hygienedevice and providing feedback to the user based on the extractedcharacteristics. The present disclosure also generally relates tosystems and methods using an oral hygiene device including at least oneaccelerometer to determine a quality of a brushing motion of the oralhygiene device.

2. Description of the Related Art

While correct oral hygiene is important, correcting one's oral hygienetechnique is oftentimes difficult. One solution to this problem is foran individual to demonstrate their oral hygiene technique while in thepresence of an oral hygiene professional, such as a dentist, and havethe oral hygiene professional correct any mistakes performed by theindividual. This, however, has inherent flaws because the individual maynot remember all of the corrected aspects, as well as the fact that theuser may not perform their true oral hygiene technique while in thepresence of the oral hygiene professional. Furthermore, over time, theindividual's oral hygiene technique may regress to the previousincorrect manner and/or a new incorrect style, or the individual maydevelop new, incorrect techniques.

One proposed solution to such a problem is to create a “game” whereperforming correct oral hygiene technique is rewarded by an individualwinning the game, whereas incorrect oral hygiene techniques leads to onelosing the game. Although this concept may work for children, it isoften impractical and ineffective for adults. Furthermore, playing thegame may only help one correct their oral hygiene technique while thegame is being played, and the individual is not able to see how theiroverall oral hygiene technique is improving, or when they are deviatingtoo far from a correct technique. Still further, such oral hygiene gamesare not typically transportable and therefore not capable of providingan individual with real-time feedback regarding the efficacy of theiroral hygiene care.

SUMMARY OF THE INVENTION

Accordingly, it is an objective of this disclosure to provide an oralhygiene device, such as an electronic toothbrush, that is capable ofextracting motion characteristic of a user operating the oral hygienedevice and providing feedback to the user regarding the efficacy oftheir technique. This objective is achieved according to the presentdisclosure by analyzing motion characteristics of the oral hygienedevice and, based on data acquired from at least one sensor includedwithin the oral hygiene device or at least one image capturingcomponent, provide feedback to the user informing them of the efficacyof their operation of the oral hygiene device. Furthermore, it isanother object of this invention to provide a user device capable ofdetecting motion characteristics of a user operating an oral hygienedevice. The user device is further operable to extract motioncharacteristics of the user operating the oral hygiene device, andprovide feedback to the user.

In a first exemplary embodiment, a method for providing feedback to auser operating an oral hygiene device including at least one sensor isprovided. In one embodiment, data acquired by the at least one sensor ofthe oral hygiene device is received. The acquired data is then analyzedto determine a quality of motion of the oral hygiene device operated bythe user. Feedback is then provided to the user based on the determinequality of motion.

In a second exemplary embodiment, an oral hygiene device is provided.The oral hygiene device, in one embodiment, includes a handle includinga power drive system, an attachment assembly, a drive train assemblycoupled to the attachment assembly, a magnet operable to produce amagnetic field, at least one sensor mounted within the magnetic fieldproduced by the magnet, and at least one processor. The at least oneprocessor is operable to acquire data from the at least one sensor. Thedata corresponds to deformations of the magnetic field relative to theat least one sensor, the deformations occurring in response to theattachment assembly having an external force applied thereto whileinteracting with a region of interest of a user that is operating theoral hygiene device.

In a third exemplary embodiment, a method for enhancing a user'sefficacy while operating an oral hygiene device is provided. In oneembodiment, at least one image is captured from an image capturingcomponent. A region of interest for operating the oral hygiene device isthen determined based on the at least one captured image. Based on thedetermined region of interest, characteristics corresponding to a motionof the oral hygiene device operated by the user are extracted. Theextracted characteristics corresponding to the motion of the oralhygiene device operated by the user are then analyzed to determine aquality of motion of the oral hygiene device. Feedback is then providedto the user regarding the determined quality of motion of the oralhygiene device.

In a fourth exemplary embodiment, a user device for aiding a user inenhancing an effectiveness for operating an oral hygiene device isprovided. The user device includes at least one image capturingcomponent, a display screen, communications circuitry, memory, and atleast one processor. The at least one processor is operable to captureat least two images of the user operating the oral hygiene device usingthe at least one image capturing component. In response to detectingthat the user is operating the oral hygiene device in a region ofinterest, motion information of the oral hygiene device is extractedfrom the at least two captured images. The extracted motion informationof the oral hygiene device operated by the user is then analyzed bycomparing the extracted motion information to a predefined targetedmotion for the oral hygiene device stored in memory on the user device.The comparison determines a quality of the extracted motion of the oralhygiene device. Feedback is then provided to the user operating the oralhygiene device, where the provided feedback includes the quality of theextracted motion information.

In a fifth exemplary embodiment, a method for determining if a user isusing an oral hygiene device correctly is provided. In some embodiments,motion information of an oral hygiene device is received from at leastone accelerometer located within the oral hygiene device. The receivedmotion information is then compared to a targeted motion of the oralhygiene device. If it is determined that the received motion informationis within a predefined threshold range of the targeted motion of theoral hygiene device, feedback is provided to a user operating the oralhygiene device. For example, provided feedback may correspond to hapticfeedback and/or visual feedback.

In a sixth exemplary embodiment, an oral hygiene device operable todetermine a quality of brushing by a user is provided. The oral hygienedevice includes a handle portion including a power drive system, anattachment assembly, memory located within the handle portion, at leastone accelerometer located within the handle portion, and at least oneprocessor. The at least one processor is operable to obtain informationfrom the at least one accelerometer corresponding to a brushing motionof the oral hygiene device. The obtained information corresponding tothe brushing motion of the oral hygiene device is then compared to atargeted brushing motion for the oral hygiene device that is storedwithin the memory. A difference between the brushing motion of the oralhygiene device and the targeted brushing motion for the oral hygienedevice is then calculated, and a score for the brushing motion of theoral hygiene device is generated based on the calculated difference.

In a seventh exemplary embodiment, a user device for providinginformation to a user operating an oral hygiene device regarding aquality of the user's brushing motion is provided. The user deviceincludes a display screen, communications circuitry, memory, and atleast one processor. The at least one processor is operable to receiveinformation obtained by at least one accelerometer located on the oralhygiene device. The received information corresponds to at least one ofa frequency, an amplitude, and an energy of a brushing motion of theoral hygiene device, in some embodiments. It is then determined if atleast one of the frequency, amplitude, and energy of the brushing motionof the oral hygiene device is one of greater than and equal to apredefined threshold value for a targeted brushing motion of the oralhygiene device. If at least one of the frequency, amplitude, and energyof the brushing motion is one of greater than and equal to thepredefined threshold value for the targeted brushing motion of the oralhygiene device, one or more of at least one of the frequency, amplitude,and energy of the brushing motion of the oral hygiene device, and adifference between at least one of the frequency, amplitude, and energyof the brushing motion of the oral hygiene device and the predefinedthreshold value for the targeted brushing motion of the oral hygienedevice is displayed on the display screen.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features of the present invention, its nature andvarious advantages will be more apparent upon consideration of thefollowing detailed description, taken in conjunction with theaccompanying drawings in which:

FIG. 1A is an illustrative diagram of an oral hygiene device 10including at least one sensor in accordance with various embodiments;

FIG. 1B is an illustrative diagram of an oral hygiene device 10 inaccordance with various embodiments;

FIG. 1C is an illustrative diagram of oral hygiene device 10 and a userdevice 150 in accordance with various embodiments;

FIG. 2 is an illustrative diagram of a user interface 200 in accordancewith various embodiment;

FIGS. 3A and 3B are illustrative diagrams of user interfaces 300 and300′, respectively, in accordance with various embodiments;

FIG. 4 is an illustrative diagram of a user interface 400 in accordancewith various embodiments;

FIG. 5 is an illustrative flowchart of a process 500, in accordance withvarious embodiments;

FIG. 6 is an illustrative diagram of a system 2 including a user device150 and oral hygiene device 10 in accordance with various embodiments;

FIG. 7 is an illustrative block diagram of a user device 150 inaccordance with various embodiments;

FIG. 8 is an illustrative diagram of an image 800 of a user inaccordance with various embodiments;

FIGS. 9A and 9B are illustrative diagrams describing a change in alocation of a device 10 in accordance with various embodiments;

FIG. 10 is an illustrative diagram describing a change in a location ofdevice 10 based on a change in pixel position and frame in accordancewith various embodiments;

FIG. 11 is an illustrative diagram describing a change in a location ofdevice 10 based on a change in a position vector between device 10 and areference object in accordance with various embodiments;

FIG. 12 is an illustrative diagram describing a change in a location ofdevice 10 based on a change in a center of gravity of a captured imagein accordance with various embodiments;

FIG. 13 is an illustrative diagram of various user interfaces inaccordance with various embodiments;

FIG. 14 is an illustrative flowchart of a process 1100 in accordancewith various embodiments;

FIG. 15 is an illustrative diagram of user device 10 being used inaccordance with various embodiments;

FIGS. 16A-E are illustrative diagrams of attachment assembly 20 of anoral hygiene device being used to brush one or more teeth 1304 inaccordance with various embodiments;

FIG. 17 is an illustrative flowchart of process 1700 in accordance withvarious embodiments;

FIG. 18 is an illustrative flowchart of a process 1800 in accordancewith various embodiments;

FIG. 19 is an illustrative flowchart of a process 1900 in accordancewith various embodiments; and

FIG. 20 is an illustrative flowchart of a process 2000 in accordancewith various embodiments.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

The present invention may take form in various components andarrangements of components, and in various techniques, methods, orprocedures and arrangements of steps. The referenced drawings are onlyfor the purpose of illustrated embodiments, and are not to be construedas limiting the present invention. Various inventive features aredescribed below that can each be used independently of one another or incombination with other features. Furthermore, as used herein, thesingular form of “a”, “an”, and “the” include plural references unlessthe context clearly dictates otherwise.

FIG. 1A is an illustrative diagram of oral hygiene device 10 includingat least one sensor in accordance with various embodiments. Oral hygienedevice 10 includes a housing 18 containing a drive train assembly 12resonantly driven by a power system 14 which includes a battery and anelectronics carrier (e.g., a printed circuit board or PCB). Oral hygienedevice 10 further includes a printed circuit board with a microprocessorcontrol 15 for creating a drive signal for power system 14. Removablysecured to a drive stem 23 from the drive train assembly 12 is anattachment assembly 20, at the distal end of which is a brush member 21.At a rear end of drive train assembly 12 is a magnet 30, and mountedwithin oral hygiene device 10 is also at least one sensor 32. In oneexemplary embodiment, at least one sensor 32 is a Hall Effect sensor. Amore detailed description of an oral hygiene device including at leastone Hall Effect sensor can be found in commonly assigned InternationalPatent Application Publication No. WO 2014/037856, which is incorporatedherein by reference in its entirety.

In one embodiment, sensor(s) 32 is a Hall Effect sensor capable ofmeasuring a strength of a magnetic field within housing 18. A magneticfield is capable of being generated by a magnet 30. Application of aHall Effect sensor in the exemplary embodiment, measures the magneticfield strength relative to the Hall Effect sensor. When an externalload, or force, is applied to attachment assembly 20, a deformation ofthe magnetic field within housing 18 occurs. This deformation ismeasured via sensor(s) 32, and may provide information regarding anamount of force applied to attachment assembly 20.

In one embodiment, at least one sensor 32 is a force sensor. The forcesensor may be included in place of the Hall Effect sensor and/or inconjunction with the Hall Effect sensor. The force sensor allows forinformation to be extracted from oral hygiene device 10 corresponding toan amount of force applied to attachment assembly 20. In one embodiment,however, the amount of force applied to attachment assembly 20 may alsobe extracted from a Hall Effect sensor. For example, the force appliedto attachment assembly 20 may be obtained, in one embodiment, using theLorentz Force law.

In one embodiment, sensor(s) 32 may also include one or moreaccelerometers capable of determining how quickly (e.g., a velocityand/or acceleration) oral hygiene device 10 is moving. In oneembodiment, the accelerometers are operable to measure changes in themotion of oral hygiene device 10 by determining a change in anorientation of oral hygiene device 10 with respect to gravity (seebelow).

In one embodiment, an additional pre-processing step is performed toremove any effects of gravity from the accelerometer's signal. Forexample, the accelerometer's signal may have added noise due togravitational effects detected by the accelerometer. By applyingpre-processing, such as a low or high-pass filter, the noise may beremoved such that accurate analysis of the accelerometer's motion mayoccur.

FIG. 1B is an illustrative diagram of oral hygiene device 10 inaccordance with various embodiments. In the illustrated exemplaryembodiment oral hygiene device 10 also includes additional componentslocated within housing 18.

Oral hygiene device 10, in the illustrated non-limiting embodiment,includes a processor or processors 102, memory 106, communicationscircuitry 108, and an input/output interface 110. These components maybe located on microprocessor control 15, or may be located elsewherewithin the housing 18. Processor 102 may include any processingcircuitry, such as one or more processors capable of controlling theoperations and functionality of oral hygiene device 10. In oneembodiments, processor 102 facilitates communications between variouscomponents within device 10 (e.g., sensor(s) 32 and communicationscircuitry 108).

Memory 106, in one embodiment, includes one or more storage mediums.Various types of storage mediums include, but are not limited to,hard-drives, solid state drives, flash memory, permanent memory (e.g.,ROM), or any other storage type, or any combination thereof. Any form ofdata or content may be stored within memory 106, such as photographs,music files, videos, contact information, applications, documents, orany other file, or any combination thereof. Memory 106 also, in oneembodiment, includes cache memory, semi-permanent memory (e.g., RAM), orany other memory type, or any combination thereof. In one embodiments,memory 106 may be used in place of and/or in addition to externalstorage for storing data on oral hygiene device 10.

Communications circuitry 108, in one embodiment, includes any circuitrycapable of connecting to a communications network and/or transmittingcommunications (voice and/or data) to one or more additional userdevices and/or servers. Communications circuitry 108 is capable ofinterfacing with the communications network using any suitablecommunications protocol including, but not limited to, Wi-Fi (e.g.,802.11 protocol), Bluetooth®, radio frequency systems (e.g., 900 MHz,1.4 GHz, and 5.6 GHz communications systems), infrared, GSM, GSM plusEDGE, CDMA, quadband, VOIP, or any other protocol, or any combinationthereof.

Input/output interface 110, in one embodiment, includes any suitablemechanism or component for receiving inputs from a user operating oralhygiene device 10 and/or generating outputs from a user operating oralhygiene device 10. Input/output interface 110 may include, but is notlimited to, an external keyboard, mouse, joystick, or any other suitableinput mechanism, or any combination thereof. In one embodiment,input/output interface 110 includes a display capable of displaying auser interface thereon.

Oral hygiene device 10 is operable to acquire data from sensor 32 or anyother sensor resident therein, and analyze the data to determine aquality of a brushing motion of the user operating oral hygiene device10. For example, sensor(s) 32 may be a Hall Effect sensor or a Forcesensor or both. In one particular example, a Hall Effect sensor may beused to extract force information. As another example, sensor(s) 32 mayinclude one or more accelerometers. In one embodiment, the analyzed datais used to provide feedback to the user via input/output interface 110.For example, input/output interface 110 may include a display screenoperable display a user interface including analysis of the user'squality of brushing. As another example, input/output interface 110 mayprovide an audio, visual, or haptic feedback to the user based on theanalyzed data acquired by the at least one sensor 32. Persons ofordinary skill in the art will also recognize that although at least onesensor 32 is used to acquire data, one or more additional sensors may beused.

FIG. 1C is an illustrative diagram of oral hygiene device 10 and userdevice 150 in accordance with various embodiments. In the illustratedexemplary embodiment, user device 150 includes one or more processors102, storage 104, memory 106, communications circuitry 108, andinput/output interface 110. Oral hygiene device 10, in the illustratedexemplary embodiment, is substantially similar to oral hygiene device 10of FIG. 1A with the exception that it also include communicationscircuitry 108, which is substantially similar to communicationscircuitry 108 of user device 150.

Communications circuitry 108, in one embodiment, enables data acquiredby sensor(s) 32 to be transmitted from oral hygiene device 10 to userdevice 150 via communications circuitry 108. For example, data fromsensor(s) 32 (e.g., a Hall Effect sensor) of oral hygiene device 10 maybe transmitted to user device 150 via a Wi-Fi connection, a Bluetoothconnection, and/or a hardwire connection.

Data acquired by sensor(s) 32 of oral hygiene device 10 corresponds todetected deformations of a magnetic field formed within housing 18 oforal hygiene device 10 based on a user operating oral hygiene device 10.For example, when an external force or load is applied to attachmentassembly 21, a deformation may occur to the magnetic field withinhousing 18 that is measurable by sensor(s) 32. The data is capable ofbeing sent from oral hygiene device 10 to user device 150 forprocessing, analysis, and/or providing feedback to the user operatingoral hygiene device 10. For example, data acquired by sensor(s) 32, suchas a Hall Effect sensor, may be analyzed on user device 150 using one ormore algorithms stored within memory 106, which determine a quality ofthe brushing of the user. Feedback is then capable of being provided tothe user regarding the determined quality of their brushing motion. Inone embodiment, the feedback is displayed on a display screen presentinga user interface.

Persons of ordinary skill in the art will recognize that oral hygienedevice 10 may refer to any product able to attend to an individual'soral hygiene, including, but not limited to, electric toothbrushes,non-electric toothbrushes, floss devices, water jets, tongue cleaners,or any other oral hygiene device, or any combination thereof.Furthermore, in at least one embodiment, oral hygiene device 10 mayrefer to a personal hygiene device, such as an electronic shaver, hairtrimmer, personal groomer, etc., and the foregoing illustrations are notlimited to just oral hygiene scenarios.

FIG. 2 is an illustrative diagram of a user interface 200 in accordancewith various embodiments. User interface 200, in one embodiment, isdisplayed on a user device including a display screen (e.g.,input/output interface 110 of user device 150). For example, userinterface 200 may be displayed on a touch-sensitive display screen foundon a handheld device such as a smart phone or tablet. As anotherexample, user interface 200 may be displayed on a display screen of anelectric toothbrush (e.g., input/output interface 110 of oral hygienedevice 10 as shown in FIG. 1B.

User interface 200, in the illustrated embodiment, includes informationcorresponding to the activity of a user operating oral hygiene device 10including one or more sensor(s) 32

In the illustrated embodiment, user interface 200 includes a graphsection 202 and a comments section 204. Graph section 202 displays agraphical representation 206 of data obtained from sensor(s) 32 of oralhygiene device 10, and in particular, an amplitude of a brushing motionof oral hygiene device 10 over a period of time that oral hygiene device10 is in operation. Graph section 202 allows a user operating oralhygiene device 10 to visually see how their brushing technique appliespressure to their teeth over time, and allows a user to correct variousinconsistencies that may arise in their technique. For example, ifgraphical representation 206 has an amplitude that is continually high,low, or generally inconsistent, the user will be able to visually seethat information represented within graph section 202 via graphicalrepresentation 206. Furthermore, graphical representation 206 enables auser to visualize the frequency of their brushing motion and determineif their brushing technique is too fast or too slow.

Comments section 204, in the illustrative embodiment, includes commentsgenerated by user device 150 displaying on user interface 200 thatcorrespond to the user's brushing technique. For example, if the user isapplying a correct amount of pressure to their teeth, a message stating“PRESSURE LOOKS GOOD!” may be displayed on user interface 200, whereasif the user is not applying enough pressure, a message stating “PRESSUREIS TOO LOW” may be displayed on user interface 200. Other commentsrelated to the frequency of the user's brushing and/or the quality ofthe user's brushing compared to a previous brushing session are alsoable to be displayed within comments section 204.

In one embodiment, one or more algorithms resident on user device 150and/or oral hygiene device 10 obtain data from sensor(s) 32 (e.g., aHall Effect sensor) and convert that data into a numericalrepresentation. The numerical representation may then be compared to apredefined value for brushing pressure, frequency, and/or quality, whichare operable to cause one or more different messages to appear incomments section 204. For example, a look-up table may be included inmemory 106 on user device 150 and/or oral hygiene device 10 that informsuser device 150 and/or oral hygiene device 10 to display the message“PRESSURE LOOKS GOOD!” when the obtained data from sensor(s) 32indicates that a correct amount of pressure is being applied by the useroperating oral hygiene device 10.

FIGS. 3A and 3B are illustrative diagrams of other user interfaces 300and 300′, respectively, in accordance with various embodiments. In theillustrative embodiments, user interface 300 displays graphics thatinform a user when their brushing motion is below a targeted brushingmotion, whereas user interface 300′ displays graphics that inform a userwhen their brushing motion is greater than the targeted brushing motion.User interfaces 300 and 300′ are capable of being displayed on a displayscreen of a user device that receives data obtained by sensor(s) 32 oforal hygiene device 10 and/or a display screen located on oral hygienedevice 10 and/or user device 150.

In one embodiment, the targeted brushing motion is stored in memory 106on user device 150 and/or oral hygiene device 10, which display userinterface 300. The targeted brushing motion may be defined prior to anybrushing activity occurring. For example, the targeted brushing motionmay be defined by the user, the user's parents, and/or the user's dentalprofessional. As the user brushes their teeth, sensor(s) 32 of oralhygiene device 10 acquires data related to an external force applied tooral hygiene device 10. For example, if sensor(s) 32 is a Hall Effectsensor, the external force applied will cause an internal deformation ofthe magnetic field within housing 18 of oral hygiene device 10 and theinternal deformation is measured relative to sensor(s) 32 (e.g., a HallEffect sensor) of oral hygiene device 10. The Hall Effect sensor, in oneembodiment, is set to have a data acquisition rate at least twice of anexpected maximum motion frequency, however persons of ordinary skill inthe art will recognize that any suitable acquisition rate may be usedand the aforementioned is merely exemplary.

User interface 300 includes a target brushing motion window 310 thatindicates bounds of the targeted brushing motion for the user operatingoral hygiene device 10. The user's current brushing motion is indicated,in one embodiment, by a marker 304. As the brushing motion changes overtime, a path 302 is displayed that indicates the various positions ofmarker 304 during brushing. In one embodiment, 300, marker 304 and path302 indicate that the user's brushing motion is lower than the targetedbrushing motion defined by target brushing motion window 310. The usermay be capable of visually seeing user interface 300 presented on adisplay screen (e.g., input/output interface 110) and appropriatelycorrecting their brushing technique. For example, marker 304 and path302 of user interface 300 may indicate that the brushing motion of theuser is lower than the targeted brushing motion, and therefore the usermay increase their brushing motion (e.g., frequency and/or amplitude).

In user interface 300′, the brushing motion of the user is greater thanthe target brushing motion. As seen in FIG. 3B, path 302 shows that theuser, at a point 356, has exceeded the target brushing motion defined bytarget brushing motion window 310. In this particular scenario, the useris able to view user interface 300′ and correct their brushing bydecreasing their frequency and/or amplitude of brushing to return to thetarget brushing motion.

FIG. 4 is an illustrative diagram of another user interface 400 inaccordance with various embodiments. User interface 400, in oneembodiment, is displayed on a display screen (e.g., input/outputinterface 110). In one embodiment, user interface 400 includes a scoringinformation chart 402 that details a user's brushing score each time theuser brushes their teeth. For example, a score may be given to eachbrushing session, where the higher the score, the better the brushingsession, and the lower the score, the worse the brushing session.

In one exemplary embodiment, scoring information chart 402 includes amorning score and an evening score for each day of one week. Persons ofordinary skill in the art will recognize that although only seven (7)days and two sessions per day are displayed, any number of days and anynumber of sessions may be included within scoring information chart 402.A scoring information graph 404 is displayed within user interface 400,in one embodiment, that tracks the user's brushing score graphically sothat the user visualizes whether or not their brushing technique isimproving from day to day. This may be especially useful for parents touse with their children to ensure that they are continually brushingtheir teeth and that they are learning proper oral hygiene care and notrepeating the same incorrect brushing techniques.

User interface 400 also includes, in the illustrative embodiment, ashare score report button 406 and a save score report button 408. Sharescore report button 406 allows data included within scoring informationchart 402 and/or scoring information graph 404 to be shared with one ormore contacts, social media websites, and/or user devices. For example,a user particularly proud of their score for a certain week may sharetheir scoring information with their family member or friends. Asanother example, a user may share their scoring information with theirdental professional to inform them of their diligent care.

Save score report button 408, in one embodiment, allows a user to storetheir score(s) on their user device 150. For example, a user may storeeach score from week to week on their user device so that a robust dataset may be produced to review with their dental professional at theirnext appointment. The saved scoring information may be stored in amemory on a user device 150 and/or on a cloud storage system with whichthe user has an account on or which may be accessed by other individuals(e.g., parents, dental professionals, etc.).

FIG. 5A is an illustrative flowchart of process 500 for providingfeedback to a user operating oral hygiene device 10 in accordance withvarious embodiments. Process 500 begins at step 502. At step 502, datais acquired, in one embodiment, from sensor(s) 32 of oral hygiene device10. For example, data may be acquired from a Hall Effect sensor locatedon oral hygiene device 10. In another embodiment, data is acquired fromone or more additional sensors located on oral hygiene device 10, suchas a force sensor and/or a combination of a force sensor, a Hall Effectsensor, and/or an accelerometer. In some embodiments, that date may betransmitted to user device 150 via communications circuitry 108 and108′. Various ways that the data is transferable from oral hygienedevice 10 to user device 150 include, but are not limited to,Bluetooth®, Wi-Fi, cellular data, and/or a wired connection.

In one embodiment, sensor(s) 32 is set to have an acquisition rate atleast twice an expected maximum motion frequency. The motion frequencytypically ranges between 0.1 Hz and 8 Hz. If the motion frequency is 0.1Hz, then the acquisition rate should be at least 0.2 Hz, whereas if themotion frequency is 8 Hz, then the acquisition rate should be at least16 Hz, for example. In one particular embodiment, the acquisition rateis set to be approximately 30 Hz. However, persons of ordinary skill inthe art will recognize that any acquisition rate may be set for anymaximum motion frequency, and the aforementioned is merely exemplary.

At step 504, pre-processing of the acquired data is performed by one ormore algorithms stored in memory 106 by processor(s) 102 of oral hygienedevice 10 and/or user device 150. Pre-processing the acquired dataallows, in one embodiment, the data to be modified so that it can bemore readily analyzed. In one embodiment, pre-processing of the acquireddata corresponds to downscaling or subsampling the acquired data. Inanother embodiment, data reduction is performed on the acquired data toemphasize the brushing motion information. For example, Empirical ModeDecomposition (“EMD”) may be performed on the acquired data to turn rawbrushing motion signals to create a collection of Intrinsic ModeFunction (“IMF”) data, which highlights the extrema and/orzero-crossings of the brushing force information. In yet anotherembodiment, pre-processing of the acquired data corresponds toapplication of a band-pass filter to remove noise/irrelevant frequencyinformation. For example, a 4 Hz low-pass filter may be applied thatremoves all frequency information exceed 4 Hz. In one embodiment, thefrequency and amplitude relationship may be changed using timeintegration and/or differentiation. Persons of ordinary skill in the artwill recognize that, in one embodiment, pre-processing of the acquireddata may not be required because the data, as initially acquired, mayalready be in a suitable format.

At step 506, the brushing motion of oral hygiene device 10 is analyzedbased on the pre-processed acquired data. In one embodiment, theanalysis is performed by processor 102 of oral hygiene device 100 and isbased on one or more algorithms stored in memory 106 of oral hygienedevice 10. In another embodiment, the analysis is performed by processor102 of user device 150, and is based on one or more algorithms stored inmemory 106 of user device 150. User device 150, for example, maycorrespond to a smartphone or tablet, and therefore may include greaterprocessing capabilities than oral hygiene device 10. The one or morealgorithms are operable to decompose the acquired data's analyzablefeatures, such as, for example, brushing motion frequency and/orbrushing motion amplitude.

The brushing motion frequency, in one embodiment, is extracted usingFourier analysis to detect a dominant motion frequency using maximumamplitude detection. For example, motion components are windowed using aHanning window and then sent to a Fast Fourier Transform (“FFT”), toextract dominant frequencies by an index of the maximal frequencyamplitude. As another example, a Hilbert transformation may be used forsubstantially instantaneous frequency estimation.

In another exemplary embodiment, the brushing motion frequency isdetermined by extracting extrema or a number of zero-crossing in themotion components. Akin to frequency estimation, assuming that adominant frequency carrier in the obtained signal is in fact thefrequency of interest, extraction of the extrema and/or zero-crossingsenables the overall system to correlate with expert assessment.

In still another exemplary embodiment, a three band-pass filter is used.The three-band-pass filter is capable of being implemented in softwareresident on oral hygiene device 10, or user device 150, for example. Thethree band-pass filter operates to compute an amount of energy as a RootMeans Square (“RMS”) value in an upper and lower band of the threebands, relative to an amount of energy in a middle band, to indicate adominant brushing frequency. For example, after the signal is obtainedand translated into the frequency domain, an amount of energy in eachband of the three bands is determined. If a first, second, and thirdband go from 0.5-1.5 Hz, 1.5-2.5 Hz, and from 2.5 Hz and higher,respectively, the energy values for each band are extracted, and theband including the dominant amount of energy is determined. Whicheverband includes the dominant amount of energy will reveal the regionincluding the dominant frequency.

The brushing motion amplitude, in one embodiment, is obtained bydetermining a distance between consecutive extrema of the motionsignals. For example, the distance between two consecutive extrema maycorrespond to an amount of time transpiring between two maximum, orminimum, motion signals. The motion signals may change in amplitude overtime, therefore the distance between consecutive extrema may be referredto as a temporal distance or a time between consecutive extrema. Inanother embodiment, the brushing motion amplitude is extracted based onthe amplitude of the dominant frequency in the Fourier representation ofthe obtained signals. As still yet another embodiment, the brushingmotion amplitude is obtained by enveloping about the motion components.

In one exemplary embodiment, additional features of the brushing motionare analyzed based on the brushing motion frequency and brushing motionamplitude extracted. Derivatives of the signal may be used to obtainvarious characteristics of the user's brushing pattern. For example, afirst order derivative of the brushing signal will yield velocityreadings corresponding to the user's motion. This data is capable ofbeing used to determine how quickly a user is moving oral hygiene device10 from tooth to tooth, for example. As another example, a second orderderivative of the brushing signal will yield acceleration readingscorresponding to the user's brushing motion. Integrations of the signalsmay be used to obtain various characteristics of the user's brushingpattern as well. For example, an acceleration may initially be obtainedvia sensor(s) 32. The acceleration may be integrated a first time toobtained a velocity of oral hygiene device 10. A second integration mayalso be performed from the velocity obtained to generate positioninformation for oral hygiene device 10.

At step 508, feedback is provided to a user operating oral hygienedevice 10, where the feedback is based, in one embodiment, on theanalysis of the user's brushing motion. In one embodiment, the providedfeedback corresponds to information displayed by means of a userinterface, such as user interfaces 200, 300, 350, and/or 400 on oralhygiene device 10 and/or user device 150. The information displayedtherein may inform the user of a quality of their brushing motion. Forexample, display screens 300 and 350 indicate how well a user isadhering to a predefined brushing motion by informing the user when theyare brushing below a target brushing motion or above a target brushingmotion. As another example, user interface 200 indicates a user'sbrushing motion amplitude and/or frequency, as well as informativemessages letting the user know how their current brushing motion relatesto a predefined target brushing motion.

In one embodiment, audio, visual, and/or haptic feedback is provided tothe user based on the analysis of their brushing motion. For example, ifthe user is applying more pressure than they should be, oral hygienedevice 10 and/or user device 150 may provide a vibration, an audiosignal (e.g., a beep), and or a visual signal (e.g., a flashing light)informing the user that their brushing motion is incorrect.

In one embodiment, the size of oral hygiene device 10 dictates whichtype of feedback is provided to the user. For example, if a user device150 is not used, and oral hygiene device 10 is too small to include adisplay screen, or oriented such that while brushing, the user is notcapable of viewing a display screen, visual feedback may be difficult orineffective. In this particular scenario, an audio signal or hapticresponse may be more suitable. However persons of ordinary skill in theart will recognize that any type of feedback may be provided to the userin any suitable manner, and the aforementioned are merely exemplary. Forexample, a display screen on user device 150 may display user interface300 or 350, which may indicate to a user operating oral hygiene device10 that their brushing motion is too low or too high, while at the sametime an audio signal may be generated by oral hygiene device 10 tosignify the incorrect brushing technique of the user.

FIG. 6 is an illustrative diagram of system 2 including a user device150 and oral hygiene device 10 in accordance with various embodiments.User device 150 of system 2, in one illustrative non-limitingembodiment, includes a camera 602 and a display screen 604. For example,user device 150 may correspond to a user's smart phone or tablet, whichmay include software resident thereon to analyze a user's brushingmotion while they operate oral hygiene device 10. A motion of a useroperating oral hygiene device 10, in one embodiment, is capable of beingviewed/monitored by camera 602 of user device 150 for analysis, as wellas providing feedback to the user operating oral hygiene device 10,which is explained in greater detail below. In one embodiment, userdevice 150 and oral hygiene device 10 are operable to couple with oneanother via connection means 610. Connection means 610 includes anywireless or wired connection including, but not limited to, Bluetooth®,Wi-Fi, cellular (e.g., LTE), and/or hardwire connections. In oneembodiment, connection means 610 enables feedback to be provided fromuser device 150 to oral hygiene device 10, or vice versa. In anotherembodiment, user device 150 further includes one or more additionalcomponents such as processing circuitry, feedback circuitry, and/orcharging circuitry. In one embodiment, user device 150 includes chargingcircuitry 656 to that is capable of charging power system 14 of oralhygiene device 10. For example, user device 150 may be a base stationcompatible with oral hygiene device 10.

FIG. 7 is an illustrative block diagram of user device 150 in accordancewith various embodiments. User device 150, may be a smartphone ortablet, or may be a base station for an electronic toothbrush (e.g.,oral hygiene device 10) or electronic shaver. In yet another exemplaryembodiment, user 150 also includes one or more camera for capturingimages and/or videos.

User device 150, in the illustrative exemplary embodiment, includes oneor more processors 102, storage 104, memory 106, communicationscircuitry 108, and input/output interface 110. Camera 602, in oneexemplary embodiment, corresponds to any image capturing componentcapable of capturing images and/or videos. For example, camera 602 maycapture photographs, sequences of photographs, rapid shots, videos, 3Dimages/videos, or any other image type, or any combination thereof.

Input/output interface 110, in the illustrative embodiment, may alsoinclude a display 604 and a speaker 718 or any other suitable mechanismor component for generating outputs. Display 604, in one embodiment,corresponds to any type of display capable of presenting content to auser and/or on user device 150. Display 604 is capable of being any sizeand located on one or more regions/sides of user device 150. Forexample, display 604 may fully occupy a first side of user device 150,or may occupy only a portion of the first side. Various display typesinclude, but are not limited to, liquid crystal displays (“LCD”),monochrome displays, color graphics adapter (“CGA”) displays, enhancedgraphics adapter (“EGA”) displays, variable graphics array (“VGA”)displays, or any other display type, or any combination thereof. In oneembodiment, display 604 is a touch screen and/or an interactive display.In another embodiment, the touch screen includes a multi-touch panelcoupled to processor(s) 702 of user device 150. In still anotherembodiment, display 604 is a touch screen including capacitive sensingpanels.

Speaker 718, in one embodiment, corresponds to any suitable mechanismfor outputting audio signals. For example, speaker 718 may include oneor more speaker units, transducers, or array of speakers and/ortransducers capable of broadcasting audio signals and audio content to auser interfacing with user device 150. In one embodiment, speaker 718corresponds to headphones or ear buds capable of broadcasting audiodirectly to a user operating user device 150.

In one exemplary embodiment, user device 150 includes one or morecomponents of oral hygiene device 10 of FIG. 1A. For example, userdevice 150 may includes sensor(s) 32, magnet(s) 30, drive train assembly12, power system 14, microprocessor control 15, and attachment assembly20. Persons of ordinary skill in the art will recognize that althoughuser device 150 includes one or more features of oral hygiene device 10,any number of additional components may be added, or any number ofcomponents may be removed, and the aforementioned description is merelyexemplary. Furthermore, user device 150, in one embodiment, issubstantially similar to oral hygiene device 100 of FIG. 1B with theexception that the former includes one or more of cameras 602, display604, and/or speaker 718.

In one exemplary embodiment, user device 150 corresponds to oral hygienedevice 10, with the exception that the former includes camera 602embedded therein. In one embodiment, camera 602 may be external suchthat it protrudes from housing 18 of oral hygiene device 10 to captureimages of attachment assembly 20 (e.g., the brush member 21) whileinteracting with the user's teeth. In another embodiment, camera 602 isembedded in attachment assembly 20. In this particular scenario, camera602 may include one or more lights (e.g., LEDs, infrared) to illuminatea portion of the user's mouth that will be interacted with. Variouslandmarks within a user's mouth may then be used as a reference point todetermine motion and/or quality of brushing activity. For example, auser's tongue, palate, and/or palatine uvula may be used as a “landmark”to determine where in the user's mouth oral hygiene device 10 islocated. Motion is capable of being determined, in one embodiment, basedon changes in captured images between one image and a subsequent imagebased on differences between the two images, such as differences inposition of a tooth or teeth with respect to the physical landmark.

FIG. 8 is an illustrative diagram of image 800 of a user in accordancewith various embodiments. Image 800 includes a face 802, a neck 804, anda torso 806 of the user. Head 802 includes eyes 808, nose 810, and mouth812. In one embodiment, one or more additional features may be includedto describe the user including, but not limited to, ears, eyebrows,chins, cheeks, hair, and/or nostrils.

In one embodiment, a region of interest 820 is included within image 800of the user. In one embodiment, region of interest 820 corresponds to arelevant portion of the user where motion corresponding to the useroperating oral hygiene device 10, will occur, such as shown in FIG. 9.For example, region of interest 820 may, when the user is brushing theirteeth, correspond to a region surrounding mouth 812. As another example,if the user is shaving, region of interest 820 may be slightly largersuch that portions of the user's face 802 where one may shave areincluded.

In one embodiment, region of interest 820 may be predefined by the user.For example, a user may manually draw an outline of region of interest820 on a user interface displayed on display screen 604of user device150. As another example, the user may be presented with region ofinterest 820 approximated by user device 150, and the user may manuallyadjust the borders of region of interest 820 such that they moreappropriately conform with the user's facial structure.

In one embodiment, region of interest 820 is determined based ondetection of one or more facial or body features of the user by userdevice 150. In one exemplary embodiment, detection of the user's face802 and torso 806 are performed using any suitable face detector. Forexample, a Viola-Jones object detection framework may be used to detectregion of interest 820 within image 800. In one embodiment, consecutiveimages captured by camera 602 of user device 150, have a Viola-Jonesface detector used to determine a location of various facial featureswithin image 800 of the user. After the various facial features (e.g.,nose 810, mouth 812, etc.) are determined, Equation 1 may be used todefine region of interest 820.

ROI=ROI_(previous)+Face_(Area)−[Face_(Coordinates)−1.5×Height]  Equation 1

In Equation 1, ROI is the region of interest, ROI_(previous) may includethe entire previous image or a manually inputted region of interest fromthe previous image, Face_(Area) is the area of face 802 within image 800of the user, Face_(Coordinates) are the coordinates defining where face802 is within image 800, and Height is the height of the user. Personsof ordinary skill in the art will recognize that the factor of 1.5 timesthe Height of the user is merely an approximation of where a user'smouth would be, and any one of these variables may be modified oraugmented accordingly.

In another exemplary embodiment, facial features of the user withinimage 800 are detected. For example, Supervised Descent Method (“SDM”)may be used to detect the facial features of the user. SDM, generally,learns a series of parameter updates that, incrementally, minimize themean of all Nonlinear Least Squares (“NLS”) functions in training. SDMis especially useful in scenarios where a Newtonian image alignmentmethod does not work (e.g., where the Hessian matrix for the image ispositive definite at the local minimum but may not be elsewhere, and thefunction is twice differentiable).

In one embodiment, consecutive images captured by camera 602 of userdevice 150 define the region of interest as the area below the detectedfacial features using Equation 2.

ROI=ROI _(previous) +FF_(Area)−[Face_(Coordinates)−1.5×Height]  Equation 2

In Equation 2, FF_(Area) is defined as [Min(X),Min(Y),Max(X),Max(Y)] forthe images captured by camera 602. In one embodiment, ROI_(previous)consists of the entire image 800 or a manually inputted region ofinterest.

In yet another exemplary embodiment, region of interest 820 of image 800is detected based on background subtraction techniques. For example,camera 602 of user device 150 may capture a set of consecutive images ofa user, such as a video of the user, and extract a user's foregroundimage/mask. The facial area (e.g., face 802) is extracted, in oneembodiment, using skeleton matching and region of interest 820 isdefined by Equation 1. Background subtraction, generally, allows for twoor more images to be compared so that a certain static portion of theimages is removed to highlight a particular portion. For example, amoving image overlaid on a static background may have the staticbackground removed using background subtraction as the static backgroundis consistent from image to image.

In still another exemplary embodiment, region of interest 820 of image800 is detected based on 3-D modelling. Various types of 3-D modellinginclude, but are not limited to, matching 3-D models with shapedistributions, shape matching by object recognition using shapecontexts, and symmetry descriptors for 3-D shape matching, or any othertype of 3-D modelling technique, or any combination thereof. Forexample, one or more 3-D modelling techniques may be used to detect face802 of image 800 to determine region of interest 820. As anotherexample, the region of interest may be detect by selecting an area ofimage 800 include a specific body part of the user (e.g., the user'shands). In yet another example, 3-D shape matching may be used to matchoral hygiene device 10 to a pre-computed model of an oral hygiene deviceto determine region of interest 820 by analyzing where oral hygienedevice 10 is within image 800.

In yet still another exemplary embodiment, detection of the region ofinterest 820 is performed by extraction of physical landmarks on theuser and/or oral hygiene device 10. In one embodiment, certain color,edge, texture, or other indicia may be used to specify where region ofinterest 820 should be. For example, oral hygiene device 10 may havehousing 18 shaded red. In this particular scenario, user device 150 mayanalyze images captured by camera 602 and highlight the motion of anyobject that is red, thereby tracking oral hygiene device 10. In anotherembodiment, light-based markers, such as LEDs, are used to specifyregion of interest 820. For example, oral hygiene device 10 may includeone or more infrared LEDs that may be recognized by user device 150 todetermine region of interest 820.

Persons of ordinary skill in the art will recognize that any of theaforementioned techniques for determining region of interest 820 withinimage 800 of the user may be used, or any additional technique or methodmay be used, and the exemplary embodiments are not to be construed aslimiting. Furthermore, one or more of the aforementioned techniques mayalso be used to determine brushing motion of the user after region ofinterest 820 is determined or at a substantially same time as region ofinterest 820 is determined. A more detailed explanation of one or moreof the aforementioned techniques will also be described below and in theforegoing figures.

FIGS. 9A and 9B are illustrative diagrams describing a change in alocation of such as oral hygiene device 10 in accordance with variousembodiments. A first image 900 of a user, includes, in one embodiment,the user's face 802, eyes 808, nose 810, and mouth 812. In addition,first image 900 includes a user device which, in one exemplaryembodiment, corresponds to oral hygiene device 10, or user device 150.As a user brushes their teeth, a camera, such as camera 602, captures anew location of oral hygiene device 10 within a second image 950. Oralhygiene device 10 in second image 950 is at a different position than itwas in first image 900 with respect to the user within both image 900and 950. In one embodiment, first and second images 900 and 950 are twoindividual images captured by camera 602 of user device 150, howeverfirst and second images 900 and 950 may also be consecutive imagesobtained via a video captured by camera 602.

FIG. 10 is an illustrative diagram describing a change in a location oforal hygiene device 10 based on a change in pixel position and frame inaccordance with various embodiments. In the illustrative embodiment,oral hygiene device 10 from first image 900 of FIG. 9A has an initialpixel position P1, which has a two-dimensional first pixel arrayposition (X1, Y1) and an first time when first image 900 was capturedT1. Oral hygiene device 10, in second image 950, has a second pixelposition P2, where the two-dimensional second pixel array position is(X2, Y2) and the second time when second image 950 was captured is T2.

Based on the coordinates (e.g., pixel and time) of oral hygiene device10 in first image 900 and second image 950, a change in verticaldisplacement (e.g., ΔY) and a change in horizontal displacement (e.g.,ΔX) are able to be determined. Incorporating time change (e.g., ΔT), anapproximation on the motion of oral hygiene device 10 is obtainable.Persons of ordinary skill in the art will recognize that theaforementioned is merely an approximation, and various additionalfactors such as scaling, delay, and resolution, may also affect themotion characteristics of oral hygiene device 10.

FIG. 11 is an illustrative diagram describing a change in a location oforal hygiene device 10 based on a change in a position vector betweenoral hygiene device 10 and a reference object in accordance with variousembodiments. In the illustrative embodiment, a first position vector904A is determined by processor 102 of user device 150 that signifies adistance and/or angle between oral hygiene device 10 and a referenceobject, such as nose 810 of the user. Persons of ordinary skill in theart will recognize that any other reference object may be usedincluding, but not limited to, eyes 808, mouth 812, neck 804, torso 806,or any other feature of the user or background, or any combinationthereof.

First position vector 904A, in one embodiment, includes informationregarding the positioning of oral hygiene device 10 with respect to nose810 of the user in first image 900. In second image 950, the position oforal hygiene device 10 has changed, and information regarding the newposition of oral hygiene device 10 withrespect to nose 810 of the useris included in a second position vector 904B. Each of position vectors904A and 904B are analyzed by user device 150 and a relative motion ofuser device 902 is determined based on the change in position and timingof the change of position vectors 904A and 904B. Various techniques maybe used to estimate the motion between consecutive images 900 and 950using position vectors, such as position vectors 904A and 904B,including, but not limited to, 3DRS and Optical Flow. Persons ofordinary skill in the art will recognize that any motion extractiontechnique may be used, however, and the aforementioned are merelyexemplary.

FIG. 12 is an illustrative diagram describing a change in a location oforal hygiene device 10 based on a change in a center of gravity of acaptured image in accordance with various embodiments. In one exemplaryembodiment, motion extraction is performed using absolute framedifferencing techniques. For example, a binary difference image ImDiffis computed using Equation 3:

ImDiff =abs(ImCurrent−ImPrevious)>Threshold   Equation 3

In Equation 3, ImCurrent corresponds to the current image and ImPreviouscorresponds to a previous image. For example, ImCurrent may correspondto image 950 of FIG. 9B captured by camera 602 of user device 150,whereas ImPrevious may correspond to image 900 of FIG. 9A. Thedifference between ImCurrent and ImPrevious is taken as the absolutevalue. Furthermore, in Equation 3, Threshold corresponds to a variablethat may be set by the user operating user device 150 or it may bepredefined by user device 150. For example, Threshold may correspond toan amount of noise associated with camera 602 and/or in the backgroundenvironment.

In one embodiment, the difference between ImCurrent and ImPrevious fromEquation 3 is projected along the x- and y-axis of the image planecausing two signals, ProjX and ProjY, to be formed. ProjX, in oneembodiment, is defined as being the sum of ImDiff along the y-image axisfor all values, whereas ProjY is defined as being the sum of ImDiffalong the x-image axis for all values. The maximum value for both ProjXand ProjY is then extracted and, in one embodiment, is used as a “centerof gravity” of motion. For example, a first center of gravity 906A maybe represented a center of gravity between oral hygiene device 10 andnose 810 within image 900, whereas a second center of gravity 906B mayrepresent a center of gravity between oral hygiene device 10 and nose810 within image 950. In one embodiment, each center of gravity 906A and906B are computed based on the ImDiff between that particular image andits previous image. Thus, center of gravity 906B, for example, may becalculated based on the maximum value of both ProjX and ProjY for images900 and 950. In one embodiment, the difference between consecutivecenters of gravity is used to determine the motion of oral hygienedevice 10. For example, the difference between centers of gravity 906Aand 906B may be used to determine the motion of oral hygiene device 10.

In response to extracting motion characteristics, an analysis isperformed, in one exemplary embodiment, of the user's motion. Byanalyzing and characterizing the user's motion, the raw motion signals(e.g., data acquired via one or more of camera 602 and/or sensor(s) 32)may be transformed into various motion features, such as motionfrequency, motion amplitude, and/or motion trajectory.

In one embodiment, analysis is performed by pre-processing of theacquired data. For example, various data reduction techniques may beemployed to emphasize information within the acquired data correspondingto motion of the user device (e.g., oral hygiene device 10), and thisinformation may be combined into a single, new motion component. Variousdata reduction techniques include, but are not limited to, PrincipleComponent Analysis (“PCA”), Independent Component Analysis (“ICA”),application of a low/high band-pass filter, or any other data reductiontechnique, or any combination thereof. For example, a low band-passfilter with a 4 Hz cutoff may be used to remove unwanted high-frequencydata.

In another embodiment, the analysis includes performing a frequencycharacterization. Motion frequency, in one embodiment, is extracted byusing a Fourier analysis to find dominant motion frequency via maximumamplitude detection. For example, motion components may be windowedusing a Hanning window, and then sent to a FFT, where the dominantfrequencies may be extracted by the index of the maximal frequencyamplitude. In one embodiment, frequency characterization includesobtaining motion frequency from the acquired data by extracting extrema(e.g., minima and/or maxima), or the number of zero crossings, from themotion components. Furthermore, as previously discussed, amplitudecharacterization, in one embodiment, is performed using any suitabletechnique.

In one exemplary embodiment, no data reduction techniques are needed.Here, the motion characteristics (e.g., amplitude characteristics and/orfrequency characteristics), are obtained using one or more additionaltechniques. For example, the x-direction and/or y-directioncharacteristics of the motion may be combined. As another example, alinear combination of the x-direction and/or y-direction characteristicsof the motion may be used. In yet another example, characteristicscorresponding to the strongest frequency component with respect to theamplitude component may be used. In still yet another example,characteristics corresponding to the frequency component that is closestto, or furthest from, the targeted frequency component may be used.Persons of ordinary skill in the art will recognize that the use of“x-direction” and “y-direction” is merely illustrative, and any twodirections may be used instead (e.g., x- and y-direction, x- andz-direction, y- and z-direction). Furthermore, persons of ordinary skillin the art will recognize that the targeted frequency and/or strongestfrequency component may correspond to any frequency component within thefrequency spectrum of the system, and may be chosen prior toimplementation and/or varied while performing data analysis.

FIG. 13 is an illustrative diagram of various user interfacesinaccordance with various embodiments. User interfacesdisplay variousgraphics including feedback provided to the user operating oral hygienedevice 10, or user device 150. For example, if it is determined that theuser is brushing their teeth too quickly, display 604 of user device 150may present user feedback message 1002. As another example, if it isdetermined that the user is brushing their teeth too slow, display 604of user device 150 may present user feedback message 1004 advising theuser to speed up. As yet another example, if it is determined that theuser is correctly brushing their teeth, then display 604 of user device150 may present user feedback message 1006. As still yet anotherexample, if it is determined that the user is brushing a portion oftheir teeth that was already brushed, or they are brushing a certainarea for too long a period of time, display 604 of user device 150 maypresent user a feedback message 1008 advising the user to change theposition of their brushing.

FIG. 14 is an illustrative flowchart of a process 1100 in accordancewith various embodiments. Process 1100 begins at step 1102. At step1102, data is acquired from one or more cameras located on a userdevice. For example, camera 602 of user device 150 may capture one ormore images and/or videos of a user brushing his/her teeth with oralhygiene device 10). As another example, the data may be acquired using aCMOS or CDD image sensor, as well as, or in addition to, a 3D camerasystem. Furthermore, in one embodiment, the acquired data includes dataobtained from one or more captured images/videos and one or moresensors, such as sensor(s) 32 (e.g., a Hall Effect sensor, a Forcesensor, and/or an accelerometer) of oral hygiene device 10. For example,user device 150 may capture video of the user using oral hygiene device10 while also obtaining data from sensor(s) 32.

The acquisition rate of camera 602, in one embodiment, enables relevantmotion information to be extracted. For example, motion frequency and/ormotion amplitude are extractable from the images captured by camera 602.In one embodiment, the acquisition rate of camera 602 is set to be atleast twice the expected maximum motion frequency. For example, if theexpected motion frequency is 10 Hz, the acquisition rate will be 20 Hz.

In one exemplary embodiment, an additional step (not shown) ofpre-processor the acquired data occurs. This optional step may besubstantially similar to steps 504 of process 500. For example,pre-processing of the acquired data may downscale the image by a factorof four (4) to reduce relatively large images captured by camera 602.

In another exemplary embodiment, video channel reduction may occur forvideo images captured by camera 602 of user device 150. For example,red, green, and blue channels of the captured video may be convertedinto a single luminance channel using Equation 4:

Y=0.299 R+0.587 G+0.114 B   Equation 4

In Equation 4, Y is the single luminance channel, R is the red channel,G is the green channel, and B is the blue channel. Persons of ordinaryskill in the art will recognize that the coefficients for each of thered, green, and blue channel may be modified accordingly depending onthe desired settings, and the use of the coefficients in Equation 4 aremerely exemplary.

As another example, any input channel of the video captured by camera602 may be combined using any linear or non-linear combination of theinput channels. As still yet another other example, only one videochannel, such as a green video channel, may be used. In this particularscenario, the green video channel may be used as it typically includesmost of the video signal's energy.

At step 1104, a region of interest isdetermined The region of interestis an area or portion of an image of a user that an appropriate motionanalysis will target. For example, a user brushing his/her teeth willhave region of interest 820 corresponding to an area surrounding andincluding his/her mouth. For different activities, such as shaving, hairmaintenance, flossing, etc., region of interest 820 may changeaccordingly to include portion(s) of the user's image that include theintended areas where the motion will occur.

Various techniques may be used to determine the region of interest. Forexample, the region of interest may be predefined by the user and/or theuser device, or the region of interest may be selected by the user. Inone embodiment, the region of interest is determined automatically basedon feature detection. For example, a user's face and chest may bedetected using a Viola-Jones face detector or SMD in conjunction withEquation 2. As another example, background subtraction techniques may beused to determine the region of interest, as well as 3-D modelling,and/or physical marker extraction.

At step 1106, the motion of the device is extracted using the region ofinterest as determined in step 1104. The extraction of the motion of thedevice may be performed using a variety of techniques. In oneembodiment, motion estimation techniques are used to extract the motion.For example, motion vectors are extracted using motion estimationbetween consecutive images (e.g., using 3DRS and/or Optical Flowtechniques). In one embodiment, object tracking is used to extract themotion. For example, the motion is extracted by tracking a real orvirtual object (e.g., oral hygiene device 10), or the relative distancebetween an object and a landmark (e.g., a vector between oral hygienedevice 10 and nose 810 of the user). In yet another embodiment, absoluteframe differencing is used to extract the motion. Here, a binarydifference image between a first image and a second image is computed,and then a maximum value along each axis of the image is determined andused as a center of gravity for the motion. The various centers ofgravity are then used in consecutive images to determine the motion.

At step 1108, the extracted motion is analyzed and decomposed intovarious components, such as motion frequency, motion amplitude, and/ormotion trajectory. In one embodiment, pre-processing is used to reducethe data. For example, a PCA, ICA, or a band-pass filter may be appliedto the data to remove irrelevant or unneeded information. In oneembodiment, frequency characterization is performed to extract motionfrequency. For example, motion frequency may be extracted using Fourieranalysis to detect a dominate motion frequency and/or by extractingextremas or zero crossings in the motion components. In one embodiment,amplitude characterization is performed to extract motion amplitude. Forexample, the distance between consecutive extremas, a dominate frequencyin the Fourier representation, and/or an envelope of the motioncomponents may be used to extract motion amplitude.

At step 1110, feedback is provided to the user based on the analysisperformed at step 1108. In one embodiment, the motion characteristicsare compared to a targeted motion stored on the user device. Forexample, a predefined targeted motion of a user brushing their teeth maybe stored in storage 104 or memory 106 on user device 150. After motionof the user device (e.g., oral hygiene device 10) is extracted, it maybe analyzed by comparing it to the predefined target motion. The resultsof this analysis are the capable of being presented to the user ondisplay 604 of user device 150 so that the user is able to modify theirmotion to conform with the predefined targeted motion. For example,display 604 may present user interfaces 1002, 1004, 1006, or 1008 ofFIG. 11, or user interfaces 200, 300, 300′, and/or 400.

In one embodiment, the motion characteristics are used to compute ascore presented to the user either in real-time or after the motion isperformed. For example, as seen in FIG. 4, user interface 400 includesvarious scores of a user for brushing sessions. The scores are computedand capable of being presented to the user so that they are able to seedays or times when their brushing was good or bad. As another example, auser may be presented with user interfaces 300 or 300′, which may allowa user to see in real-time how well they are adhering to target brushingwindow 310. If their brushing is too low (e.g., user interface 300) theuser may modify their brushing to increase pressure and/or frequency,whereas if their brushing is too great (e.g., user interface 300′), theuser may modify their brushing to decrease pressure or frequency.

FIG. 15 is an illustrative diagram of oral hygiene device 10 being usedin accordance with various embodiments. Patient interaction system 1200includes, in one exemplary non-limiting embodiment, face 802 and mouth812 of a patient operating oral hygiene device 10. When a patientbrushes their teeth, tongue, gums, etc., the patient moves oral hygienedevice 10 such that a scrubbing motion occurs about the patient's teeth(see FIGS. 16A-E).

Depending on an orientation of the patient's teeth, the motion of oralhygiene device 10 when the patient brushes their teeth (e.g., thedirection of scrubbing) varies. For example, a patient may move oralhygiene device 10 in a first and second direction, as seen by arrow1202, or oral hygiene device 10 may be moved in a third and fourthdirection, as seen by arrow 1204. Moving oral hygiene device 10 alongthe first and second direction may, for example, be better suited forcleaning of a patient's front teeth, whereas moving oral hygiene device10 along the third and fourth directions may be better suited forcleaning a patient's back teeth. However, persons of ordinary skill inthe art will recognize that oral hygiene device 10 may be moved in anysuitable direction to perform a brushing or scrubbing action, and theaforementioned are merely exemplary. Furthermore, the patient may brushone or more teeth along one or more directions (e.g., a front tooth orteeth may be brushed along the directions of both arrows 1202 and 1204).

FIGS. 16A-E are illustrative diagrams of attachment assembly 20 of anoral hygiene device being used to brush one or more teeth 1304 inaccordance with various embodiments. Patient mouth 812, in theillustrated exemplary embodiment, includes gums 1302 having a pluralityof teeth 1304. Patient's mouth 812 may correspond to an upper or lowerportion of a patient's mouth, such as an upper maxillary portion or alower mandibular portion.

A patient, in one embodiment, moves attachment assembly 20 of oralhygiene device 10 along a first direction 1202 a to provide a scrubbingaction to teeth 1304. The scrubbing action, or brushing motion, may beperformed in any suitable direction such that attachment assembly 20moves along gums 1302 having teeth 1304 therein. As seen in FIGS. 16Band 16C, attachment assembly 20 moves perpendicular to a face of teeth1304. For example, attachment assembly 20 of oral hygiene device 10 maybrush an outer surface of teeth 1304 and/or an inner surface of teeth1304.

As attachment assembly 20 moves back and forth along a first direction1202 a and a second direction 1202 b, one or more sensors 32 within oralhygiene device 10, are capable of detecting the movement of attachmentassembly 1306. For example, sensors 32 of oral hygiene device 10 maycorrespond to one or more accelerometers. Various types ofaccelerometers include, but are not limited to, standaloneaccelerometers, parts or all of one or more inertial measurement units(“IMUs”), gyroscopes, and/or magnetometers. The accelerometers may alsobe single or multi-axis accelerometers. For example, various single axisaccelerometers may be used within oral hygiene device 10, to detectchanges in motion of oral hygiene device 10 along multiple axes (e.g.,x-, y-, and/or z-axis). As another example, multi-axes accelerometersmay be used to detect motion of oral hygiene device 10 along two or moreaxes (e.g., x and y-axis, x and z-axis, y and z-axis, or x, y, z-axis).In one particular embodiment, oral hygiene device 10 includes at leastone accelerometer along a longitudinal axis of drive shaft 23. In oneexemplary embodiment, a blind analysis may be performed using variousmulti-axes and/or single axis accelerometers. For example, the variousmulti-axes and/or single axis accelerometers may be capable of detectionmotion in all spatial directions and analyzing an amount of energy,frequency, and/or amplitude detected along each axis. The motion of oralhygiene device 10 is then capable of being reconstructed based on thedetermined motion.

In one embodiment, processor(s) 102 of oral hygiene device 10 and/oruser device 150 set the acquisition rate of the accelerometers withinoral hygiene device 10 to be at least twice an expected maximum motionfrequency of the brushing/scrubbing. The accelerometers detect themotion of oral hygiene device 10 as they move along various axes toperform a brushing motion (e.g., move along directions 1202 a and/or1202 b). When the motion detected by the accelerometer corresponds toproper brushing/scrubbing technique, processor(s) 102 of oral hygienedevice 10 and/or user device 150 provide information (as describedbelow) that the brushing motion is correct. If the detected motion bythe accelerometer corresponds to incorrect brushing/scrubbing technique,processor(s) 102 of oral hygiene device 10 and/or user device 150provide information.

FIGS. 16D and 16E are various perspective views of the brushing motiondescribed in FIGS. 16B and 16C, in accordance with various embodiments.To provide proper oral hygiene care, a patient should brush their teeth1304 such that a minimal amount of side force occurs on attachmentassembly 20 (e.g., such as a brush head) of oral hygiene device 10. Asattachment assembly 20 moves along a direction 1202 a, attachmentassembly 20 also provides a force F in a direction 1504, which isperpendicular to the direction of motion 1202 and parallel and oppositeto an outer surface of teeth 1304. For example, force F allows forbristles on attachment assembly 20 to interact with teeth 1304 to removeplaque, water, toothpaste and/or other elements from teeth 1304 and/orgums 1302 to clean teeth 1304 and/or gums 1302.

As a user brushes their teeth 1304, a minimal amount of side forceshould be applied to attachment assembly 20 such that a maximal amountof normal force F is applied to teeth 1304. Persons of ordinary skill inthe art will recognize that although a minimal amount of side force isapplied to attachment assembly 20, the applied normal force F plusfrictional effects may cause a non-zero amount of side force to bedetected by attachment assembly 20. As seen in FIG. 16E, attachmentassembly 20 of oral hygiene device 10, when moving in direction 1402and/or 1454, has a force F1, 1602,applied to an outer surface of teeth1304 such that a side force F2, 1604 is as small as possible. In oneparticular example, the amount of side force F2 is zero. As described ingreater detail above, minimizing side force F2 provides maximal brushingefficacy. In some embodiments, in addition to determining an amount ofmotion of attachment assembly 20 (and thus, oral hygiene device 10),accelerometers (e.g., sensors 32) may also be able to determine an anglethat attachment assembly 20 is interacting with teeth 1304. For example,oral hygiene device 10 may include one or more accelerometers thatmeasure motion and one or more accelerometers that measure an amount ofgravitational force or gravitational acceleration of oral hygiene device10. Oral hygiene device 10 and/or user device 150 are capable ofcomparing the direction of motion measured by the one or moreaccelerometers measuring motion of oral hygiene device 10 with adirection or orientation of the gravitational force as detected by thegravitational accelerometer(s) to determine an angle between thedirection of motion and gravity.

FIG. 17 is an illustrative flowchart of process 1700 in accordance withvarious embodiments. Process 1700, in one embodiment, begins at step1702. At step 1702, motion information is received from one or moreaccelerometers located on or within oral hygiene device 10. For example,as a patient brushes their teeth using oral hygiene device 10, sensor(s)32, such as one or more accelerometers, located thereon detectinformation corresponding to a displacement, velocity, acceleration,and/or angle of the motion of oral hygiene device 10. In one exemplaryembodiment, sensor(s) 32 (e.g., an accelerometer) on oral hygiene device10 detects information corresponding to a motion of oral hygiene device10, which is transmitted to user device 150, 700 for processing and/oranalysis. For example oral hygiene device 10 may transmit motioninformation detected by sensors 32 (e.g., accelerometers) to user device150 using communications circuitry 108.

At step 1704, the motion information received at step 1702 is comparedto a targeted motion for brushing of teeth 1304 using oral hygienedevice 10, For example, a frequency of the brushing motion may bedetected by sensor(s) 32 (e.g., accelerometers) located on oral hygienedevice 10, which may be compared to a predefined frequency value orfrequency range corresponding to proper or correct brushing. In oneembodiment, the predefined frequency value is stored in memory 106 onoral hygiene device 10 or user device 150. The predefined frequencyvalue, in one embodiment, corresponds to a range of frequency valuesassociated with proper or correct brushing motion. For example,frequency values corresponding to correct brushing motion may correspondto 1-5 Hz, however any suitable frequency or range of frequencies may beused.

At step 1706, a determination is made as to whether the received motioninformation is within a predefined threshold of the targeted motion. Forexample, at step 1704, the motion of oral hygiene device 10 may becompared to the targeted motion of oral hygiene device 10 correspondingto proper or correct brushing technique. If the comparison determinesthat the difference between the brushing motion detected by theaccelerometers and the targeted motion is less than a predefinedthreshold value then process 1700 proceeds to step 1708. If thedifference between the detected brushing motion is greater than thepredefined threshold value then process 1700 proceeds to step 1710. Forexample, if the targeted brushing motion for proper brushing using oralhygiene device 10 is between 1-5 Hz and the detected motion is 3 Hz,then oral hygiene device 10 is within the threshold range for properbrushing. If, however, the detected motion is 10 Hz, then the brushingmotion of oral hygiene device 10 is not within the threshold values forproper brushing.

In some embodiments, the comparison that occurs at step 1706 may be abinary decision. For example, the detected frequency of the receivedmotion of oral hygiene device 10 may be compared to the targetedbrushing motion for oral hygiene device 10. If the detected motion islower than a maximum threshold frequency value or greater than a minimalthreshold frequency value, then the detected motion is considered to becorrect. However, if the detected motion is greater than the maximumthreshold frequency value or less than the minimal threshold frequencyvalue, then the detected motion is considered to be correct. In oneembodiment, the comparison may be a continuous decision where a positionin the frequency range is used to determine a score for the brushingmotion (e.g., see below). For example, a range of frequencies for atargeted brushing motion may be between 1-9 Hz. If the detectedfrequency is 5 Hz, the score may be 50%, whereas if the detectedfrequency is 1 Hz or 9 Hz, the score may be 100% or 0%, respectively.However, persons of ordinary skill in the art will recognize that thecomparison techniques described above are merely exemplary and anycomparison technique may be used.

If, at step 1706, it is determined that the received motion information,as compared to the targeted motion information, is within a predefinedthreshold value, then process 1700 proceeds to step 1708 where feedbackis provided to a user operating oral hygiene device 10 and/or userdevice 150. In one exemplary embodiment, the provided feedback is hapticfeedback. For example, the provided haptic feedback may be a vibrationof oral hygiene device 10. As another example, the provided hapticfeedback may be an audible sound or tone outputted by oral hygienedevice 10, or by user device 150. In another exemplary embodiment, thefeedback provided to the user operating oral hygiene device 10 isvisual. For example, a user interface including one or more images maybe presented on display 604 of user device 150, or oral hygiene device10. Various types of feedback presented to the user operating oralhygiene device 10 may include positive feedback, instructions orinformation regarding the brushing motion of oral hygiene device 10, orany other type of information, or any combination thereof. As anillustrative example, a user may be presented with user interface 200,300, 300′, and/or 400.

If, at step 1706, it is determined that the brushing motioned of oralhygiene device 10 is not within the predefined threshold of the targetedbrushing motion, process 1700 proceeds to step 1710 where a differencebetween the received motion information measured by the accelerometerson oral hygiene device 10 and the targeted brushing motion comparisonperformed at step 1704 stored in memory 106 of oral hygiene device 100or user device 150 is calculated. In one exemplary embodiment, asdescribed previously, a determination is made as to whether the receivedmotion information is less than, or greater than, a predefined thresholdfrequency value. In this particular scenario, the received motioninformation does not meet the predefined threshold frequency value, andthe difference between the received motion information (e.g., afrequency of motion) and the targeted brushing motion frequency iscalculated. For example, the received motion information from theaccelerometers located on oral hygiene device 10, may indicate that theuser is moving oral hygiene device 10 at a frequency of 15 Hz. In thisparticular example, the targeted brushing motion frequency may be 5 Hz,and a threshold frequency value for the targeted motion may be +/−4 Hz(e.g., between 1-9 Hz). Thus, the calculated difference between themotion of oral hygiene device 10 and the targeted brushing motion fororal hygiene device 10 may be 10 Hz. However, persons of ordinary skillin the art will recognize that the motion information and the targetedbrushing motion information described above are merely exemplary.Furthermore, persons of ordinary skill in the art will recognize thatthe calculated difference between the received brushing motioninformation of oral hygiene device 10 and the targeted brushing motionmay also include a difference between the received motion informationand the threshold value for the targeted brushing motion. For example,using the scenario described previously, the difference between thefrequency of motion of oral hygiene device 10 and an upper limit of thetargeted motion frequency may be 6 Hz. This may allow a user to knowapproximately how close (or how different) they are to being within therange of proper or correct brushing technique.

At step 1712, feedback is provided to the user operating oral hygienedevice 10 that includes, in one embodiment, the calculated differencebetween the received motion information and the targeted brushingmotion. For example, a user may be provided with haptic feedback inresponse to the received motion information not being within thepredefined threshold of the targeted information. The provided hapticfeedback, in one embodiment, corresponds to a vibration or buzzing oforal hygiene device 10, which may indicate to the user that theirbrushing motion is incorrect. After the haptic feedback occurs, the usermay be able to view, either on oral hygiene device 10 or on user device150, the calculated difference between the motion information of oralhygiene device 10 and the targeted brushing motion. For example, display604 of oral hygiene device 100 and/or user device 150, may have agraphical user interface displayed thereon that includes the calculateddifference between the brushing motion of oral hygiene device 10 and thetargeted brushing motion. In one embodiment, the feedback provided tothe user is visual feedback, and no haptic feedback is provided. In yetanother embodiment, audible feedback, such as an audio tone, is playedthrough oral hygiene device 100 and/or user device 150 in addition to,or instead of, the haptic and/or visual feedback.

FIG. 18 is an illustrative flowchart of process 1800 in accordance withvarious embodiments. Process 1800 begins at step 1802 where motioninformation is received from one or more accelerometers (e.g., sensors32) located on oral hygiene device 10, 100. For example, accelerometerslocated on oral hygiene device 10 may measure an acceleration and/ormotion (e.g., magnitude and/or direction) of oral hygiene device 10while it is being used to brush a patient's teeth (e.g., teeth 1304). Inone exemplary embodiment, step 1802 of process 1800 is substantiallysimilar to step 1702 of process 1700, and the previous descriptionapplies.

At step 1804, one or more axis that the received motion informationcorresponds to is determined For example, the accelerometers on oralhygiene device 10 may be single or multi-axes accelerometers. If theaccelerometers on oral hygiene device 10 are single axis accelerometers,processors 102 of oral hygiene device 10 and/or user device 150 maydetermine which accelerometers detected motion. For example, thedetected motion may be only along the x-axis accelerometer. As anotherexample, the detected motion may be along both the x-axis accelerometerand the z-axis accelerometer. This may provide information regarding anaxis or axes of motion for oral hygiene device 10. If the accelerometerson oral hygiene device 10, 100 are multi-axis accelerometers, processors102 of oral hygiene device 10 and/or user device 150 may determine whichaxis or axes the motion of oral hygiene device 10 occurs on from themulti-axis accelerometers.

As an illustrative example, oral hygiene device 10 may include threesingle axis accelerometers, such as an x, y, and z axis accelerometer.Processors 102 of oral hygiene device 10 and/or user device 150 maydetermine that only the x-axis accelerometer has detected motion, andtherefore may determine that the motion of oral hygiene device 10 isonly along the x-axis. As another illustrative example, processors 102of oral hygiene device 10, also including three single axisaccelerometers, may determine that the x-axis accelerometer and thez-axis accelerometer have both detected motion. Thus, in this particularscenario, the motion of oral hygiene device 10 may be along a portion ofthe x-axis and the z-axis. As still yet another example, processors 102of oral hygiene device 10 may include 3 multi-axis accelerometers, suchas an x-y axis accelerometer, an x-z axis accelerometer, and a y-z axisaccelerometer. In this particular scenario, the x-y axis accelerometermay have detect motion, whereas the x-z and y-z axis accelerometer havenot. Thus, processors 102 of oral hygiene device 10 may determine thatthe motion of oral hygiene device is along an x-y axis. However, personsof ordinary skill in the art will recognize that the aforementioned ismerely exemplary, and if motion is detected by an x-y axisaccelerometer, some motion may also be detected along an x-z axisaccelerometer (an x-axis component) and a y-z axis accelerometer (ay-axis component).

At step 1806, a determination is made as to whether the axis or axesthat the motion information is determined to correspond to includes agravity component. In one exemplary embodiment, a gravity may beassigned to be aligned with the z-axis. However this is merelyexemplary, and the axis of gravity may vary depending on the specificembodiment or application oral hygiene device 10 is used for. If, atstep 1806, it is determined that the axis the motion informationcorresponds to includes a gravity component then process 1800 proceedsto step 1808. At step 1808, the gravity component is accounted for alongthat axis or axes. For example, in the aforementioned example usingthree single axis accelerometers, an x-axis accelerometer and a z-axisaccelerometer may have both detected motion. The z-axis, as describedpreviously, may corresponds to an axis of gravity, and therefore themotion detected along the z-axis may include a component due to gravity.Thus, processors 102 of oral hygiene device 10 and/or user device 150may account for the gravitational component and modify the output usedfor analysis from that accelerometer (e.g., the z-axis accelerometer).In one embodiment, an accelerometer that has motion detected along itsaxis that corresponds to gravity may have its outputs suppressed. Forexample, if the z-axis corresponds to gravity, an accelerometerdetecting motion along the z-axis may have its output suppressed orweighted differently to negate or minimize the effects of gravity forthe motion of oral hygiene device 10. In one embodiment, the one or moreaccelerometers located on oral hygiene device 10 are not be aligned withan axis of gravity. In this particular scenario, more than oneaccelerometer may detect a gravitational component. Thus, variouscomponent breakdowns of the motion of oral hygiene device 10 may occurusing processors 102 to determine a direction and magnitude of thegravitational component. After the gravitational component has beendetermined along each accelerometer, the gravitational component isaccounted for along that accelerometer, and process 1800 proceeds tostep 1810.

If, however, at step 1806, it is determined that the axis or axes thatthe received motion information for oral hygiene device 10 does notinclude a gravitational component, process 1800 proceeds to step 1810.At step 1810, one or more of: frequency value, an amplitude value, andan energy value of the brushing motion is determined. For example,processors 102 of oral hygiene device 10 and/or user device 150 mayanalyze the motion information detected by the accelerometers (e.g.,sensors 32) and determine a frequency of the brushing motion that oralhygiene device 10 has when brushing teeth 1304. As another example, themotion information may be analyzed to determine an amount of energywithin the brushing motion. In one embodiment, the energy may includeinformation regarding the amplitude and/or frequency of the brushingmotion. However, persons of ordinary skill in the art will recognizethat the motion information may focus or include any amount ofinformation corresponding to the brushing motion detecting by the one ormore accelerometers on oral hygiene device 10, and the aforementioned ismerely exemplary.

After one or more of the frequency, amplitude, and/or energy of thebrushing motion is determined, a query is run at step 1812 to assesswhether the determined brushing frequency, amplitude, and/or energymeets a predefined condition corresponding to correct or proper brushingmotion for oral hygiene device 10. For example, a threshold frequencyvalue, amplitude value, and/or energy value for brushing may be set onby a user operating oral hygiene device 10 and/or a user operating userdevice 150. The threshold frequency, amplitude, and/or energy value maybe an upper or lower value such that if the determined brushingfrequency, amplitude, and/or energy exceeds or is less than,respectively, the threshold frequency, amplitude, and/or energy value,the brushing motion of oral hygiene device 10 is incorrect, whereas ifthe determined brushing frequency, amplitude, and/or energy of oralhygiene device 10 is less than or greater than, respectively, thethreshold frequency, amplitude, and/or energy value, the brushing motionof oral hygiene device 10 is correct.

As an illustrative example, a pre-set brushing frequency upper thresholdvalue may be set at 5 Hz. If the frequency of the brushing motion isgreater than 5 Hz, then the brushing motion is not correct. However, ifthe brushing motion has a frequency less than or equal to 5 Hz then thebrushing motion is correct.

In one embodiment, a range corresponding to a lower and upper frequency,amplitude, and/or energy threshold value for correct brushing is used.As an illustrative example, a pre-set brushing frequency threshold rangemay be between 1 and 9 Hz. If the determined frequency of the brushingmotion of oral hygiene device 10 is less than 1 Hz or greater than 9 Hz,then the brushing motion is incorrect. However, if the determinedfrequency of the brushing motion of oral hygiene device 10 is greaterthan or equal to 1 Hz but less than or equal to 9 Hz, then the brushingmotion is correct.

If, at step 1812, the brushing frequency, amplitude, and/or energy meetsthe pre-set condition, the process 1800 proceeds to step 1814. Forexample, if the upper limit for the brushing frequency is 5 Hz, thenproper brushing technique would correspond to the frequency of brushingof oral hygiene device 10 being less than or equal to 5 Hz. Forscenarios where the pre-set condition is met, process 1800 proceeds tostep 1814 where feedback is provided to a user operating oral hygienedevice 10 indicating that their brushing motion is correct. For example,a user interface displayed on oral hygiene device 10, or user device 150may indicate to the user that they are brushing their teeth 1304correctly.

If, however, the brushing frequency, amplitude, and/or energy determinedat step 1812 does not meet the pre-set condition, process 1800 proceedsto step 1816. At step 1816, feedback is provided to the user operatingoral hygiene device 10 that informs the user that they are brushingtheir teeth incorrectly. For example, a user interface may be presentedto the user on oral hygiene device 10, or user device 150. In oneembodiment, haptic feedback, such as an audible tone or vibration oforal hygiene device 10, may be provided in response to it beingdetermined that the frequency of the user's brushing motion is incorrect(e.g., does not meet the predefined condition for proper brushingmotion). In one embodiments, both haptic and visual feedback areprovided to the user operating oral hygiene device 10, however personsof ordinary skill in the art will recognize that any other additionaltype of feedback may be provided to the user, and the aforementioned aremerely exemplary.

FIG. 19 is an illustrative flowchart of a process 1900 in accordancewith various embodiments. Process 1900 begins, in one embodiment, atstep 1902. At step 1902, motion information for oral hygiene device 10is received from one or more accelerometer(s) (e.g., sensors 32) locatedon oral hygiene device 10. In one exemplary embodiment, step 1902 ofFIG. 19 is substantially similar to step 1702 of FIG. 17, and theprevious description applies.

At step 1904, a maximum frequency, amplitude, and/or energy of thebrushing motion of oral hygiene device 10 is determined based on themotion information received from the accelerometers at step 1902. Thereceived motion information from the accelerometers located on oralhygiene device 10 includes, amongst other information, frequency,amplitude, and/or energy information regarding the brushing motion oforal hygiene device 10. In one exemplary embodiment, the amplitude ofthe motion of oral hygiene device 10 is analyzed, and the maximumbrushing amplitude is determined. In another exemplary embodiment,multiple maximum brushing amplitudes are determined. For example, amaximum brushing amplitude may be determined every 10 seconds or after auser moves oral hygiene device 10 to a different location within theirmouth. In another exemplary embodiment, a maximum brushing amplitude,and the next few (e.g., five (5)) maximum brushing amplitudes are alsodetermined at step 1904. For example, a maximum brushing amplitude isdetermined, and then the next maximum amplitude (e.g., an amplitudegreater than all the other amplitudes except for the maximum amplitude)is determined, and so on. In yet another exemplary embodiment, an energysignal of the brushing motion may be analyzed, and a maximum energysignal may be determined From the maximum energy signal, a maximumfrequency and/or amplitude may also be determined as the energy signalmay include frequency and/or amplitude information.

In one embodiment, the amplitude of the signal detected by the one ormore accelerometers is defined using Equation 1:

A=l/2(2πf)²   Equation 1

where l is the displacement of housing 18, attachment assembly 20,and/or drive shaft 23 (depending on the amplitude being measured), and fis the frequency of the displaced objects movement. Persons of ordinaryskill in the art will recognize that any other portion of oral hygienedevice 10 may be used to measure an amount of displacement 1, and theaforementioned is merely exemplary. As an illustrative example, if thedisplacement l=0.05 m, and the frequency f=2 Hz, then the amplitude willbe approximately 3.95.

At step 1906, a determination is made as to whether or not the maximumfrequency, amplitude, and/or energy of the brushing motion is within apredefined threshold range for brushing frequency, amplitude, and/orenergy of oral hygiene device 10. In one embodiment, a predefinedmaximum frequency, amplitude, and/or energy for correct brushing motionis stored in memory 106 on oral hygiene device 100, or user device 150y. The maximum brushing frequency, amplitude, and/or energy determinedat step 1904 is compared to the predefined maximum frequency, amplitude,and/or energy for correct brushing motion to determine if the determinedmaximum brushing frequency, amplitude, and/or energy is within a rangeof the predefined maximum brushing frequency, amplitude, and/or energy.For example, if the predefined brushing amplitude is A, the range forthe predefined maximum brushing amplitude may be A±10% of A. As anotherexample, the predefined maximum brushing amplitude may be an upper orlower threshold, such that correct brushing motion corresponds to themaximum brushing amplitude being greater than or equal to A (if A is alower threshold), or less than or equal to A (if A is an upperthreshold).

If, at step 1906, it is determined that the determined maximum brushingfrequency, amplitude, and/or energy of the brushing motion of oralhygiene device 10 is within the predefined threshold range, then process1900 proceeds to step 1908. At step 1908, feedback is provided to theuser indicating that the brushing motion is correct. For example, a usermay be presented with user interface indicating that they are brushingcorrectly. If, however, at step 1906, it is determined that thedetermined maximum brushing frequency, amplitude, and/or energy is notwithin the predefined threshold range, then process 1900 proceeds tostep 1910. At step 1910, feedback is provided to the user operating oralhygiene device 10 indicating that the brushing motion is incorrect, andinstructions to correct the brushing motion are provided. For example,if a user has a brushing amplitude that is much smaller than thepredefined threshold brushing amplitude, the user may be presented witha user interface on oral hygiene device 10 or user device 150instructing the user to brush with a greater amplitude. As anotherexample, if the user has a brushing amplitude that is much greater thanthe predefined threshold for maximum brushing amplitude, then the usermay be presented with a user interface on oral hygiene device 10 or userdevice 150, instructing the user to decrease the amplitude of theirbrushing motion of oral hygiene device 10. In one exemplary embodiment,additional feedback, such as haptic feedback and/or audio feedback, arealso provided to the user. For example, if the determined maximumbrushing amplitude is smaller than, or greater than the predefinedthreshold range for the maximum brushing amplitude, then an audible tonemay be outputted by user device 150 indicating to the user that theirbrushing motion is incorrect. In one exemplary embodiment, a first audiotone is outputted if the determined maximum brushing amplitude is toolow, whereas a second audio tone is outputted if the determined maximumbrushing amplitude is too high.

FIG. 20 is an illustrative flowchart of a process 2000 in accordancewith various embodiments. Process 2000, in one embodiment, begins atstep 2002. At step 2002, motion information is received from one or moreaccelerometers (e.g., sensors 32) located on oral hygiene device 10,100. In one exemplary embodiment, step 2002 of FIG. 20 is substantiallysimilar to step 1702 of FIG. 17, and the previous description applies.

At step 2004, the received motion information is compared to a targetedmotion for oral hygiene device 10. In one embodiment, a frequency,amplitude, and/or energy corresponding to correct brushing technique isstored in memory 106 on oral hygiene device 10 or user device 150.Correct brushing technique thus refers to a targeted motion for oralhygiene device. For example, a predefined frequency for a targetedbrushing motion of oral hygiene device 10 for a user is stored in memory106. As another example, a range of frequencies for a targeted brushingmotion for brushing a user's teeth using oral hygiene device 10 isstored in memory 106. The predefined frequency, amplitude, and/orenergy, and/or the range of frequencies, amplitudes, and/or energies forthe targeted brushing motion may be programed into memory 106 by adental professional, a parent or guardian of a user operating oralhygiene device 10, or by the user of oral hygiene device 10.

As an illustrative example, a predefined frequency range for a targetedbrushing motion may be a frequency between 1 and 9 Hz. The receivedmotion information includes, in one exemplary embodiment, a frequency oforal hygiene device 10 for a user's brushing. This frequency is thencompared, at step 2004, to the targeted brushing motion frequency range(e.g., 1-9 Hz). In one embodiment, the comparison is performed on oralhygiene device 10, however persons of ordinary skill in the art willrecognize that the comparison may instead, or additionally, be performedon user device 150.

At step 2006, a score is calculated based on the comparison between thereceived brushing motion information and the targeted brushing motion.Continuing the illustrative example above, if the frequency of thebrushing motion is 1 Hz, the calculate score may be 100%. If thefrequency of the brushing motion of oral hygiene device 10, 100 isinstead 5 Hz, then the calculated score may be 50%. Thus, in thisparticular scenario, frequencies closer to 1 Hz are scored higher thanfrequencies scored closed to 9 Hz.

In one embodiment, the score is calculated on oral hygiene device 10,whereas in another embodiment, the score is calculated on user device150. For example, received motion information (e.g., frequency ofbrushing) and the stored targeted brushing motion may be processed usingprocessor(s) 102 of oral hygiene device 100 and/or user device 150.Processor 102 may analyze the brushing motion information obtained bythe accelerometers on oral hygiene device 10 and compare the brushingmotion information to the targeted brushing motion information.Processor 102 may then determine the difference between the two motions.For example, if the targeted motion information is between 1-9 Hz, thecalculation may determine whether or not the received brushing motioninformation is within this range. If it is, a score may be generatedbased on predefined frequency values for the targeted motion. Afrequency of 1 Hz may, in one illustrative example, correspond to asubstantially perfect score (e.g., 100%), whereas a frequency of 5 Hzmay correspond to an average score (e.g., 50%). If the targeted motioninformation is not within the range, the calculated score may reflectthat the brushing motion is not within the targeted motion range (e.g.,a score of 0%) or the score may indicate to the user that they areoutside of the range and a score is not able to be computed (e.g., ascore of not applicable may be presented or “outside targeted brushingmotion range”).

At step 2008, the calculated score is stored in memory/storage 106 onoral hygiene device 100 and/or user device 150. For example, each time auser operates oral hygiene device 10, the calculated score of theirbrushing may be stored. In one exemplary embodiment, a user may be ableto select which instance or score is to be stored. For example, a usermay be presented with the score at step 2006 (e.g., input/outputcircuitry 110 of oral hygiene device 10 or user device 150). In responseto being presented with the score of that brushing session, the user maybe provided with an option to store that score or not store that score.If the user decides to store the calculated score, then the score isstored in storage/memory 106. However, in one embodiment, thisfunctionality may be capable of being disabled or locked such thatcertain users (e.g., children) are not able to have negative scoreserased.

At step 2010, data including the score and any additional scores obtainfrom additional brushing events is generated. In one embodiment, thegenerated data includes a timeline of a user's scores for each brushingsession over time. For example, a graph including a calculated score foreach brushing session may be presented within a display on user device150. This allows a user, a user's parent or guardian, and/or a user'soral hygiene professional to view the user's progress. In this way, auser is able to see if their brushing technique is improving (e.g.,becoming more aligned with the targeted motion) as they continue to useoral hygiene device 10, or if they are still deviating from the targetedmotion and how they can modify their brushing technique to more closelyachieve a brushing motion comparable to the targeted brushing motion. Inone exemplary embodiment, the data generated includes scores for auser's various brushing sessions, and that data is transmitted (e.g.,via email or to a remote storage platform) to the user's oral hygieneprofessional. This allows the user's dental professional to monitor theuser's brushing technique between office visits. Furthermore, the oralhygiene professional will now be able to review the user's brushingmotion technique and subsequent visits to help the user improve theirbrushing technique.

In the claims, any reference signs placed between parentheses shall notbe construed as limiting the claim. The word “comprising” or “including”does not exclude the presence of elements or steps other than thoselisted in a claim. In a device claim enumerating several means, severalof these means may be embodied by one and the same item of hardware. Theword “a” or “an” preceding an element does not exclude the presence of aplurality of such elements. In any device claim enumerating severalmeans, several of these means may be embodied by one and the same itemof hardware. The mere fact that certain elements are recited in mutuallydifferent dependent claims does not indicate that these elements cannotbe used in combination.

Although the invention has been described in detail for the purpose ofillustration based on what is currently considered to be the mostpractical and preferred embodiments, it is to be understood that suchdetail is solely for that purpose and that the invention is not limitedto the disclosed embodiments, but, on the contrary, is intended to covermodifications and equivalent arrangements that are within the spirit andscope of the appended claims. For example, it is to be understood thatthe present invention contemplates that, to the extent possible, one ormore features of any embodiment can be combined with one or morefeatures of any other embodiment.

1. A method for determining if a user is using an oral hygiene devicecorrectly, the method comprising: receiving motion information of anoral hygiene device from at least one accelerometer located within theoral hygiene device; comparing the received motion information to atargeted motion of the oral hygiene device; providing a user operatingthe oral hygiene device with feedback in response to determining thatthe received motion information is within a predefined threshold rangeof the targeted motion; and providing the user operating the oralhygiene device with instructions to modify a motion of the oral hygienedevice such that additional motion information received from the atleast one accelerometer will be within the predefined threshold range ofthe targeted motion of the oral hygiene device.
 2. The method of claim1, wherein the at least one accelerometer measures an amount of motionof the oral hygiene device on at least one of a first axis, a secondaxis, and a third axis.
 3. The method of claim 2, wherein: the firstaxis comprises a longitudinal axis of the oral hygiene devicecorresponding to a longitudinal shaft of the oral hygiene device; thesecond axis comprises a normal force axis of the oral hygiene devicecorresponding to a direction of a plurality of bristles located at anend of the longitudinal shaft; and the third axis comprises a side forceaxis of the oral hygiene device that is perpendicular to thelongitudinal axis and the normal force axis.
 4. The method of claim 1,wherein the feedback comprises haptic feedback and visual feedback. 5.The method of claim 1, wherein the motion information received from theat least one accelerometer comprises at least one of a frequency, anamplitude, and an energy of the oral hygiene device when used.
 6. Themethod of claim 5, wherein comparing further comprises: determining ifat least one of the frequency, amplitude, and energy of received fromthe at least one accelerometer is greater than a predefined thresholdvalue, wherein the predefined threshold value comprises at least one ofa frequency value, an amplitude value, and an energy value that, ifdetected, corresponds to correct brushing motion.
 7. The method of claim5, wherein the received motion information comprises the frequency,comparing further comprises: determining if the frequency received fromthe at least one accelerometer is within a predefined frequency range.8. The method of claim 7, wherein the predefined frequency rangecomprises 1-9 Hz, the method further comprises: computing a brushingscore based on a position of the frequency within the frequency range.9. The method of claim 1, further comprising: storing, in memory, atleast one of the received motion information and a difference betweenthe received motion information and the targeted motion of the oralhygiene device.
 10. (canceled)
 11. An oral hygiene device operable todetermine a quality of brushing by a user, the oral hygiene devicecomprising: a housing portion comprising a drive train assembly; anattachment assembly; memory; at least one accelerometer; and at leastone processor operable to: obtain information from the at least oneaccelerometer corresponding to a brushing motion of the oral hygienedevice; compare the obtained information corresponding to the brushingmotion of the oral hygiene device to a targeted brushing motion for theoral hygiene device stored within memory; calculate a difference betweenthe brushing motion of the oral hygiene device and the targeted brushingmotion for the oral hygiene device; generate a score for the brushingmotion of the oral hygiene device based on the calculated difference;and provide the user operating the oral hygiene device with instructionsto modify a motion of the oral hygiene device such that additionalinformation corresponding to the brushing motion of the oral hygienedeviced obtained from the at least one accelerometer will be closer tothe targeted motion of the oral hygiene device.
 12. The oral hygienedevice of claim 11, further comprising: communications circuitry thatcommunicates to a user device at least one of: the obtained informationcorresponding to the brushing motion of the oral hygiene device; thecalculated difference between the brushing motion of the oral hygienedevice and the targeted brushing motion for the oral hygiene device; andthe generated score for the brushing motion of the oral hygiene device.13. The oral hygiene device of claim 11, wherein the generated score forthe brushing motion of the oral hygiene device is stored in the memory.14. The oral hygiene device of claim 11, further comprising: an outputinterface operable to provide at least one of haptic feedback and visualfeedback based on the generated score for the brushing motion of theoral hygiene device.
 15. A user device for providing information to auser operating an oral hygiene device regarding a quality of theirbrushing motion, the user device comprising: a display screen;communications circuitry; memory; and at least one processor operativeto: receive information obtained by at least one accelerometer locatedon the oral hygiene device, the information corresponding to at leastone of a frequency, an amplitude, and an energy of a brushing motion ofthe oral hygiene device; determine if at least one of the frequency,amplitude, and energy of the brushing motion of the oral hygiene deviceis at least one of equal to and greater than a predefined thresholdvalue for a targeted brushing motion of the oral hygiene device; displayon the display screen, if at least one of the frequency, amplitude, andenergy of the brushing motion is at least one of greater than and equalto the predefined threshold value for targeted brushing motion of theoral hygiene device, at least one of: a value of at least one of thefrequency, amplitude, and energy of the brushing motion of the oralhygiene device; and a difference between at least one of the frequency,amplitude, and energy of the brushing motion of the oral hygiene deviceand the predefined threshold value for the targeted brushing motion ofthe oral hygiene device, and provide a used of the oral hygiene devicewith instructions to modify a motion of the oral hygiene device suchthat additional information corresponding to at least one of afrequency, an amplitude, and an energy of a brushing motion, receivedfrom the at least one accelerometer, will be lower than the predefinedthreshold value for the targeted motion of the oral hygiene device.